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Background 



A recognized gap - no objective measure of cognitive 
performance was available in space operations 

Mir operations indicated a need for 
cognitive/performance assessment. 

• work overload / underload 

• on-board fire - contaminated air 

• decompression - loss of module 

• dangerous atmosphere (ethylene glycol and contaminant 

leaks) 

• depression/withdrawal 


A tool was needed that required minimal interaction 
with ground controllers due to communication 
limitations 



Program Objective 



• Therefore a tool was developed - Spaceflight Cognitive 
Assessment Tool for Windows (WinSCAT) 

• Purpose is to provide ISS flight surgeons with an objective 
clinical tool to monitor the astronauts’ cognitive status 
during long-duration space flight and allow immediate 
feedback to the astronaut 

• Developed for medical operations at NASA’s Johnson 
Space Center in Houston, Texas 




Implementation 


Implementation 



WinSCAT is a medical requirement for all long-duration 
missions 

A computer-based, self-administered battery of five 
cognitive assessment subtests 

In-flight tests scheduled monthly and compared against 
individual preflight baseline level of performance 

Implemented with U.S.O.S. (United States Operational 
Segment) astronauts from one NASA/Mir mission and all 
expeditions to date (24) on the International Space 
Station (ISS). 



WinSCAT Protocol for ISS 



1 . Pre-Mission: Six one-half hour sessions for baseline 

data collection to: 

•Overcome learning effects 
•Develop individual baseline 

2. During Mission: Medically required @ 30 days: 

•Maintain proficiency & update on-orbit baseline 
•May take as often as desired for self-assessment 

3. Post-Mission: Minimum one session (R+30) 

•Check the re-adaptation to 1 G before return to flight status (additional 
administrations as medically needed) 
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Viewing Results 



• Test session is immediately scored, and all 
tests can be reviewed by the astronaut 

• Off-nominal tests appear in red 

• Monthly scores are downlinked to Behavioral 
Health & Performance Group 

• Repeat testing may occur if off-nominal 

• After a traumatic/medical event (0), WinSCAT 
testing would be indicated - contributes to 
medical decisions 



C:\Documents and Settings VAII UsersVApplication Data\WinSCAT\Data\1 1 1 Ut 1 11 .log 






Symbol Memory (Learning) 


Repeating Numbers 


Mathematical Processing 


Pattern Matching 



Symbol Memory (Memory) 
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Defining off-nominal performance 


Rules Comparison 



• Initial Scoring Rules 

- Based on validation study at the University of Northern Colorado 

- Change for accuracy and response time scores were based on a 
fixed baseline composed of last 3 preflight tests 

• New Scoring Rules 

- Based on combining data from different studies incorporating initial 
data and data from studies using 6 baseline trials 

- Off-nominal based on atypical frequency of change value 

- Change for accuracy and throughput measured against moving 
baseline 

- Incorporates a summary score based on weighted throughput 



Approaches To Assessing Change 



I. Reliable Change Index 

• SEm: Standard error of measurement 

• Sdiff: Standard error of difference score 

• r: Test-retest reliability 

• M2, Ml : Mean of T2 test score , Mean 
of T 1 test score respectively 

• SI : Standard deviation of control 

group, normal population 

• RC: 90% confidence interval 


SE m = .s'ja/I -r 

^ cliff = ) 

RC = ±1.64*5 

diff 

Mean _ Change = M ^ - M j 

Correction _ factor = Rounded ( Mean _ Change ) 
Adjusted RC = Rounded ( Correction _ factor + RC) 


II. Regression Equation: allows for adding different sources of variation 


III. Frequency (normative) based 



Normative Group 


Measure 


Trial 1 Trial 2 


Code Substitution (N = 129) 

TP Mean(Sd) 50.30(10.18) 

RT Mean(Sd) 1207(278) 

Acc Mean(Sd) 96.79(2.94) 

Running Memory CPT(N=1 15) 

TP Mean(Sd) 97.29(20.85) 

RT Mean(Sd) 567(112) 

Acc Mean(Sd) 86.69(7.79) 


Mathematical Processing (N =109) 

TP Mean(Sd) 25.89(6.58) 

RT Mean(Sd) 2135(423) 

Acc Mean(Sd) 88.89(8.71) 


Matching to Sample (N=128) 

TP Mean(Sd) 36.42(10.65) 

RT Mean(Sd) 1608(430) 

Acc Mean(Sd) 92.97(6.86) 


51.50(10.36) 

1186(280) 

97.31(2.34) 

110.83(23.38) 

529(112) 

92.66(5.76) 


27.64(7.98) 

2073(481) 

90.59(8.63) 


38.57(1 1.77) 
1559(436) 
94.43(6.68) 


Code Substitution Recognition (N =127) 


TP 

Mean(Sd) 43.72(12.78) 

39.84(11.40) 

RT 

Mean(Sd) 1276(400) 

1361(407) 

Acc 

Mean(Sd) 88.06(11.98) 

86.74(11.46) 


WinSCAT Battery 



Trial 3 

Trial 4 

54.51(11.44) 

1125(274) 

97.27(9.62) 

56.00(11.53) 

1094(332) 

96.67(2.96) 

115.17(22.39) 

511(103) 

93.62(5.07) 

118.62(22.54) 

496(95) 

94.09(4.30) 

27.00(7.22) 

2092(480) 

89.91(8.31) 

28.52(7.17) 

1976(453) 

89.76(7.59) 

39.77(13.65) 

1557(454) 

95.31(6.11) 

37.87(11.63) 

1607(478) 

94.23(7.02) 

47.42(12.21) 

1178(303) 

90.33(10.24) 

50.32(12.90) 

1122(274) 

90.99(9.34) 


Trial 5 

Trial 6 

57.48(11.76) 

1070(311) 

96.99(2.77) 

57.14(11.54) 

1064(298) 

96.08(3.52) 

120.38(23.26) 

492(98) 

94.69(4.37) 

122.58(23.24) 

480(93) 

94.31(4.96) 

31.51(7.60) 

1845(426) 

92.52(7.06) 

31.57(7.11) 

1821(410) 

92.16(7.31) 

39.02(14.10) 

1568(496) 

93.80(6.16) 

39.29(13.36) 

1555(517) 

94.06(6.91) 

51.85(13.24) 

1123(281) 

92.73(7.81) 

44.72(12.84) 

1191(310) 

86.48(11.93) 




Table 1. Passing criteria (cut scores) 

Test 

Throughput 
(change from 
baseline mean) 

Accuracy 

(% correct responses) 

Lapses 

(trials that bm e out with no 
responses) 

Code sub (teaming ) 

>-7 

>94 

<1 

Code sub (recall) 

>■ 15 

>80 

<1 

Running MemoryCPT (repeating 
numbers) 

>-8 

>8B 

<5 

Matching to Sample 

>-8.5 

>85 

<1 

Mathematical Processing 

>-5 

>80 

<2 

ICE score must be no less than 36 less than mean of baseline sessions 
Moving Baseline for all baseline comparisons 


Table 2 - Ovefai session score 

Score 

□'fcSCfifltor 

Owens 

Color 

0 

Nominal 

AH scores passed 
AND 

1C E with in expected range 

green 

1 

Marginal 

t>w score failed 
AND 

1C E with in expected range 

yellow 

2 

Off-Nominal 

Two or m ore scores failed 
OR 

1C E below expected range 

r<xf 


Overview of data from space 


Analysis 



• ISS performance data were assessed to compare 
initial to modified interpretation rules for detecting 
potential changes in cognitive functioning in space 
flight. 

• Applying the newly derived rules to ISS data (172 total 
test sessions) resulted in 158 nominal test sessions 
(92%) and 14 off-nominal performances at various 
times during flight. 

• Performance data from ISS missions do not indicate 
significant cognitive decrements due to 
microgravity/space flight alone but has shown 
decrements. 



Assessment 



• Explanations for off-nominal performances 
have included fatigue, post slam shifting, 
distraction of life events on Earth, distraction 
during testing, or minimal effort on the 
cognitive testing (obtained from post-mission 
debriefings). 


Correlation to actual events is needed. 


Way Forward 


Refine Decision Rules 



Correlation to actual events is needed 

Challenge studies to further refine change 
score analysis 

Continue assessment using space flight 
data with incorporation of additional change 
metrics 


Modifications 



WinSCAT has been updated to add network 
capability to support a 6-person crew on the 
station support computers. 

WinSCAT Version 2.0.28 has increased difficulty 
of items in Mathematics, increased number of 
items in Match-To-Sample, incorporates a 
moving rather than fixed baseline, and 
implements stricter interpretation rules. 



